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New tools make 
fuzzy/neural more than 
an academic amusement 

There's been a lot written in academic journals about combining 
fuzzy logic and neural networks. Some of this activity is finally 
coming to fruition as developers discover how to translate 
academic research into practical products. 



luzzy logic tool vendors who offer neural capability are moving cautiously. There 
seems to be a fear that moving too quickly could confuse an engineering and 
software-development community that's still trying to get comfortable with some 
of the "radical" ideas behind fuzzy logic. Nevertheless, neural network learning 
can be a boon in developing a fuzzy system where there's ample raw data available, 
but relatively little knowledge about the system's likely behavior. 

One of fuzzy logic's attractions is its ability to 
express both expert knowledge and combinatorial 
complexity in a simple set of linguistic 
rules. Equally appealing is its ability to 
run complex systems using relatively 
modest computing resources. The value of 
neural network technology, on the 
other hand, lies in its ability to find 
patterns and correlate 
BBBBfc groups of data. 
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The NeuroFuzzy module from Inform Software integrates with the company's 
fuzzyTECH fuzzy logic development tool. The NeuroFuzzy module can generate and 
optimize membership functions and rules out of sample or process data. You can 
watch the learning progress on the screen and intervene at any time, and manually 
edit the final results. 



Fuzzy logic is, perhaps, a misno- 
mer because it implies vagueness in 
a mathematical system that can 
yield precise results. By the same 
token, the term neural networks im- 
plies vast intelligence lurking in sili- 
con, which could mimic the mind of 
an Einstein, a Heisenberg or a von- 
Neumann (who embodied the ulti- 
mate in fuzziness in the uncertainty 
principle). 

In reality, a neural net is only a 
statistical tool. Both fuzzy logic and 
neural network technology, how- 
ever, share the ability to deal with 
levels of complexity that are orders 
of magnitude beyond the capabili- 
ties of conventional computer tech- 
nologies. 

Ironically, it's this ability to han- 
dle complexity that makes people 
wary of fuzzy logic and neural net- 
works. But in truth, it's easier to 
deal with high levels of complexity if 
you let go of the idea of absolute 
precision. 

I Close is good enough 

In a classical control system, for ex- 
ample, a mathematical model of a 
system's behavior is created, which 
is usually represented by some com- 
plex curve. To implement the control 
strategy implicit in the curve using 
a computer, you linearize portions of 
the curve and write some computer 
code that implements the linearized 
portions of the curve. Even though 
the linear functions may be precise, 
they don't exactly imitate the non- 
linear curve; they're only approxi- 



mate, but to an acceptable degree of 
precision. 

Similarly, a neural network can 
analyze a complex collection of data 
points and define a curve that's con- 
sidered a "best fit." But unless you're 
willing to continue training the sys- 
tem into the next century, it'll never 
be an exact fit. 

Using fuzzy logic, you first estab- 
lish a set of rules and membership 




According to National Semiconductor's 
Emdad Khan, the learning and generali- 
zation capability of neural nets can 
deliver a smart solution to a control 
problem. But as a neural network, the 
solution isn't cost-effective. "We've 
designed the neural network so that its 
learned knowledge is directly mapped 
to fuzzy logic because fuzzy is easy and 
cost-effective to implement. " 



functions based on your best knowl- 
edge of how the system will behave. 
You then simulate and optimize un- 
til the system reaches acceptable be- 
havior. All these approaches, even 
the ones you might think are precise 
mathematical models, rely on what 
Prof. Lotfi Zadeh, the inventor of 
fuzzy logic, calls "exploiting the tol- 
erance for imprecision." In other 
words, a quantity can be correct 
even if it falls within a wide range 
of values. 

When a control problem involves 
dynamic nonlinear systems, the two 
technologies working together can 
help manage the complexity and re- 
duce design time given proper tool 
support. Two advantages are that 
neural nets can learn from raw data 
and their output can be used to gen- 
erate a fuzzy rule base, which is a 
representation of a control strategy 
that you can look at and understand. 

No one has insight into the "black 
box" of a neural network and, there- 
fore, no one can directly intervene to 
"tune" it. In addition, a neural net- 
work is compute-intensive. Even af- 
ter it's learned a set of data — for 
recognizing characters, let's say — 
it's still fairly slow at actually iden- 
tifying a character when data is pre- 
sented to it. This makes neural net 
controllers almost useless for real- 
time systems. A fuzzy logic control- 
ler, on the other hand, requires rela- 
tively minimal computing resources 
to process its rules. Afuzzy rule base 
generated from a neural net that's 
learned some complex data will exe- 
cute many times faster than a neu- 
ral controller. 

I Tools for neural/fuzzy 

There are three major vendors of 
fuzzy logic tools that offer neural 
network capability: National Semi- 
conductor (Santa Clara, CA) offers 
NeuFuz, a neural network-based 
tool for automatically generating a 
complete fuzzy system; Inform 
(Aachen, Germany) supplies the 
NeuroFuzzy module as an add-on to 
its fuzzyTECH development environ- 
ment; and Togai InfraLogic (Irvine, 
CA) has a tool dubbed TILGen for 
selecting an optimal set of rules 
from a rule base generated from its 
TILShell 3.0 development tool. Al- 
though they have different capabili- 
ties, all three tools work with input 
and output data that describe the 
expected behavior of the system be- 
ing designed. 

National's NeuFuz starts with 
what is called a training set of input - 
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SYNC/570i Expands 
the New Standard in 
Synchronous Communications 




What Makes the SYNC/570i Better? 

Arnet's SYNC/570 set the new standard in synchronous 
communications by offering the performance of an 
expensive coprocessor at a fraction of the price. Now the 
SYNC/570i expands on that standard by offering both two 
and four port configurations with multiple, user-configurable 
interfaces! 

Unparalled Performance 

Like the SYNC/570, the SYNC/570i utilizes the 
powerful Hitachi 64570 SCA chip. When coupled with the 
SYNC/570i's onboard memory, the 64570's full duplex DMA 
allows the board to support line speeds better than Tl/El. 
Even up to 5 Mbps for each line! 

Your Choice of Interfaces 

Available for both ISA and Micro Channel 
-systems, the SYNC/570i can be 
configured for either two or four 
ports with RS232/V.35 or RS-530/ 
X.21 user selectable interfaces. Call 
today for more information on the 
growing list of software applications 
that now support Arnet's family of synchronous 
boards - ranging from the entry-level ArnetSync to the high 
performance SYNCom/3000 intelligent communications 
adapter. 





Arnet and Ihe Amet logo are registered trademarks of Arnet Corporation. AI] other trademarks are property of 
their respective corporations. 



Protect Your OEM Revenue 

OEMs can customize the SYNC/570 and the SYNC/570i 
to include an OEM ID or machine-readable "fingerprint." 
Guarantee the protection of your software revenue by 
programming your application to this customized 
fingerprint. 



& 



Guaranteed Reliability 

Both the SYNC/570 and the SYNC/570i are backed 
by our Rock Solid Lifetime Warranty. Plus, 
SurgeBlock onboard surge protection is 
available on all signal lines to guard against 
the leading cause of board failure - 
transient surges and spikes. 



Buy the Price/Performance Standard 

Starting at only $595 for the SYNC/570 and $695 for 
the SYNC/570i, these products deliver a new price/ 
performance standard unmatched by other PC-based 
synchronous communications controllers. Call 
1-800-377-4401 to find out more. 



& RRNET 

Rock Solid Connections from Digi International 



618 Grassraere Park Drive Nashville, TN 37211 
(615) 834-8000, (615) 834-5399, FAX 
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A look at adaptive fuzzy systems 



^\nyone who keeps contact with new 
developments in engineering has come 
across the term fuzzy logic. It's shown up 
at one time or another in most of the 
popular technical press and the debate 
about the value of fuzzy logic goes on 
unabated. But whatever that value might 
be, the issue will be resolved, ultimately, 
by the doers — not the talkers. 

How do the doers achieve their goals? 
Starting with a set of system variables 
and a desired input-output relationship 
between them, they define fuzzy sets de- 
scribing the variables and a set of rules 
describing the relationship. They succeed 
when the behavior of the resulting fuzzy 
system reproduces that relationship. Two 
questions lurk: In general, is it reason- 
able to always expect success, and if so, 
how do we manage it? 

I Good news, bad news 

The good news is that fuzzy systems are 
universal approximators. If you can ac- 
cept a system that approximates the 
ideal desired response uniformly to 
within a preassigned tolerance, Bart 
Kosko's "Fuzzy Approximation Theorem" 
says there are plenty of fuzzy systems 
that suffice. The only hitch is you have to 
find them on your own. 

The bad news is that fuzzy systems are 
inherently approximate systems. There 
are very simple multivariate functions 
that can't be exactly realized by fuzzy sys- 
tems, no matter how complicated. This 
means that a grand theory of repre- 
sentation by fuzzy systems is unattain- 
able. Since perfect accuracy is often un- 
reachable, even in principle, what we 
need is an automated way of realizing 
suitable approximate systems. 

In principle, the algorithm of a fuzzy 
system is always the same. A fuzzy sys- 
tem derives its behavior from the rule 
and fuzzy set information it contains. In 
practice, this means that we need only 
determine parametric data for the fuzzy 
system — the rules and the fuzzy sets 
they involve. Sample data extracted from 
the desired underlying relationship is the 
basis for the determination. 

Adaptive fuzzy systems are supposed 
to handle this optimization problem, 
which we call the Tuning Problem: 

Given a tolerance level and samples of 
correct behavior, choose rules and fuzzy 
sets so that the resulting fuzzy system ap- 
proximates correct behavior, to within 



tolerance, over the entire operating 
range of the system. 

If we can solve the Tuning Problem, 
any stationary input-output relationship 
can be automatically reproduced by an 
adaptive fuzzy system as long as suffi- 
cient samples of that relationship are 
available. Handmade designs would only 
be needed for problems involving time- 
varying systems. Often, the engineering 
task would reduce to the generation of 
data for an adaptive fuzzy system to use. 



Currently, there isn't a general solution 
to the Tuning Problem. The problem is 
statistical, combinatorial and nonlinear — 
an analyst's nightmare. A typical problem 
can easily involve hundreds of numbers 
to adapt. Still, there are approaches that 
have been successful. Most of those ap- 
pearing in the literature involve neural 
networks or genetic algorithms. 

Generally speaking, these methods are 
instances of what is known as stochastic 
gradient descent. Consequently, they 
don't automatically find globally optimal 
solutions but only locally optimal ones. 
The difference is similar to the one be- 
tween a molehill and a mountain range. 
At this stage, however, it's pretty much 
all we have. 

I Building an adaptive system 

One particular way to build an adaptive 
fuzzy system has been proposed, but 



probably isn't ready for full automation 
because human intervention is usually re- 
quired at one or more points. Neverthe- 
less, it's conceptually appealing and the 
successive steps are reasonably straight- 
forward to implement. The method was 
first described in print by Julie Dickerson 
and Bart Kosko, who worked out the 
computational details. 

The method, which we'll refer to as 
DK, has two main objectives: Pick a rea- 
sonably good set of rules, and optimize 
the fuzzy sets appearing in these rules. 



Each objective uses a particular kind of 
neural network. To attain the first objec- 
tive, DK uses competitive learning; for 
the second it uses supervised learning. 

Competitive learning is an unsuper- 
vised distributed algorithm that esti- 
mates the underlying probability density 
of the data it sees. It occurs in many vari- 
ants, all closely related to statistical adap- 
tive clustering procedures. DK uses it to 
locate clusters in concatenated input-out- 
put data. The idea is to locate regions 
where a local preponderance of sample 
data indicates a causal relationship. For 
example, in a simple situation, clusters 
could arise in a set of data. In a plot of 
the data, each point on the graph would 
represent a node that had summarized a 
large number of data points. 

Three clusters are immediately appar- 
ent, at least to the eye. It's not always so 
easy to locate clusters with an algorithm, 




Fred A. Watkins, Ph.D., president, Hyperlogic (Escondido, CA) 

' . . 
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but algorithms do exist that enjoy a measure 
of success as cluster-finders. Let's suppose 
we have found three clusters in the data. 

It's easy to see that if the independent 
variable is near one of the horizontal axis 
tick marks, the dependent variable value 
will fall near the corresponding vertical 
axis tick mark. All we need to formulate 
rules is some fuzzy set definitions that cap- 
ture the meaning of the phrase "near a 
tick mark." DK uses the competitive net- 
work clusters to estimate these fuzzy sets 
by using covariance ellipsoids (a multidi- 
mensional version of an ellipse). 

Each cluster represents several data sam- 
ples, and DK uses that data to compute an 
ellipsoid, which is centered at the centroid 
of the data set. Each axis of the ellipsoid 
has a length determined by the covariance 
matrix derived from the data. This "ran- 
dom ellipsoid" represents both the loca- 
tion and the variability of the data in the 
cluster: The location estimates the input- 
output relationship implicit in the data; 
the variability estimates the accuracy of 
the estimate. 

An ellipsoid determines fuzzy sets by 
projection onto the coordinate axes. Each 
input set is an isosceles triangle centered 
at the projection of the cluster centroid, 
and the base of the triangle is the projec- 
tion of the ellipsoid onto that coordinate. 

Now we have rules — one derived from 
each cluster — that connect the input vari- 
ables to the output variables in the obvi- 
ous way. If the system has two inputs and 
one output, the rule corresponding to clus- 
ter 7 might read, "If X is x-fuzzy-set-7 and 
Y is y-fuzzy-set-7 then Z is z-fuzzy-set-7." 

Competitive learning is a rapid algo- 
rithm in that it tends to reach stochastic 
equilibrium with exponential speed. It 
often finds stable clusters in just a few 
passes through the data, deriving a ruleset 
in short order. 

I Optimizing the fuzzy set 

The second phase of the DK procedure 
uses supervised learning to further opti- 
mize the fuzzy set definitions obtained in 
the first step. Supervised learning is the 
general name of a large class of stochastic 
algorithms that require both input and de- 
sired output data to adapt. The back 
propagation algorithm is the most popular 
and well-known example. 

Using the fuzzy system responses and 
the desired output data, an error measure 
can be calculated. Any consistent error 
measure is suitable; DK specifically uses 




mean square deviation. During this phase 
the supervised algorithm adjusts the cen- 
ters of the fuzzy sets to minimize the 
mean square error between the actual 
and desired system responses. 

Using competitive learning, DK rapidly 
makes a first guess at the ruleset, then re- 
fines that guess more slowly with super- 
vised learning. The first pass with competi- 
tive learning tends to produce good initial 
conditions for the supervised learning 
phase to follow. Good initial conditions 
tend to decrease the time supervised learn- 
ing requires to stabilize. 

Cluster-finding is a problem when there's 
a large amount of data. Most existing meth- 
ods are statistical and require parameter set- 
tings or other input from operators. 

I Improving on the DK method 

Leaving the problem of cluster-finding aside, 
we might ask whether the DK method can 
be improved, and if so, how it can be ac- 
complished. Since the second phase only 
tunes the centers of the fuzzy sets, it might 
be that a larger supervised network that can 
adjust the shapes as well as locations of the 
fuzzy sets could further improve system per- 
formance. Another possibility is to use an- 
nealing or other methods to improve the 
chance of avoiding local minima during the 
second phase. 

Dimensional complexity is the chief im- 
pediment to the successful use of super- 
vised learning (or any other method, for 
that matter). Suppose the first pass pro- 
duced five fuzzy sets for each of three in- 
put variables. In many cases, output fuzzy 
sets can be represented by "singletons" 
and so may not require much adjustment. 
Then, a 128-cell partition of each input di- 
mension yields a total of 1 28 x 1 5 = 1 ,920 
variables to optimize. Even if a 16-cell par- 
tition could suffice, there are still 240 vari- 
ables. Hardware that can handle such net- 
works exists but is very large and 
expensive. 

The second possibility can be imple- 
mented on small machines in many ways. 
Future research will tell us if this kind of 
approach offers substantial benefits. 

An ideal solution must arbitrarily handle 
many inputs and overcome the problem 
of local minima. It must do this in a model- 
free manner — without any prior knowl- 
edge of the underlying input-output rela- 
tionship. Given the current capabilities of 
mathematical and statistical analysis, it's 
not likely that this kind of success will oc- 
cur in the foreseeable future. 



output relationships. These data 
points can be taken from measure- 
ments of a running system or writ- 
ten as specifications to be learned. 
The more data supplied, the more 
accurately the resulting curve will 
fit the actual system behavior. You 
can specify the accuracy of the data 
supplied, as well as how "fat" the 
data points are. For example, you 
can specify a tolerance of 1 percent 
around any given point as an accept- 
able range of accuracy for the data. 
This will effect how long it takes the 
system to learn the data. 

"With NeuFuz, you can specify the 
accuracy [of the data] ," says Emdad 
Khan, head of intelligent systems 
for National Semiconductor's Em- 
bedded Systems Division. "When 
the learning is completed, it'll give 
you a solution that has that much 
accuracy." 

You can then specify a so-called 
epsilon value that represents the ac- 
curacy of the neural net learning. 
Because of the nature of neural net- 
works, however, this will never be 
100 percent accurate. Says Fred 
Watkins, president of Hyperlogic 
(Escondido, CA), "Most data is sto- 
chastic, so you don't try to reach 100 
percent. Instead, you reach for the 
kind of thing that's in regression, 
where you want the best line and the 
best curve through a bunch of data. 
Specifying an accuracy of 90 percent 
may yield a completely acceptable re- 
sult for the learning process while sav- 
ing a great deal of processing time that 
might be spent in further reduction." 

I Data & learning accuracy 

There's a difference between the ac- 
curacy of the data and the accuracy 
of the learning: The accuracy of the 
learning is the allowable difference 
between the neural net's computed 
output and the desired output val- 
ues. This aspect of accuracy depends 
on the number of data patterns sup- 
plied and the number of learning 
cycles. When all the inputs to the 
neural net produce a corresponding 
output within the predefined error 
margin, the neural net is said to 
have converged. Convergence can 
sometimes be plotted as a smooth, 
descending curve that approaches 
the epsilon value as learning cycles 
are repeated. Sometimes, however, 
the convergence oscillates and the 
descent curve shows valleys. In ac- 
tual practice, this curve is mathe- 
matically represented as a 3-D 
surface. 

The convergence can reach a point 







COMPUTER DESIGN JULY 1994 73 



I SPECIAL REPORT: BRINGING FUZZY LOGIC & NEURAL COMPUTING TOGETHER 



Toward soft computing 




"If you consciously try to exploit the 
tolerance for imprecision, you can 
solve many problems that couldn't 
be solved otherwise," says Prof. Lotfi 
Zadeh, the inventor of fuzzy logic. 



luzzy logic and neural networks both 
work with imprecision. Neural nets find 
the best curve — if not an exact curve — 
to fit a set of data. Fuzzy systems let 
you make generalizations about system 
behavior in linguistic terms and manipu- 
late them with approximate reasoning. 
This is what Prof. Lotfi Zadeh, the inven- 
tor of fuzzy logic, describes as exploit- 
ing the tolerance for imprecision. It's 
something you either do consciously or 
unconsciously in many real-world situ- 
ations. 

"The most telling example is high- 
definition television," says Zadeh. "To 
squeeze an HDTV signal into a standard 
TV bandwidth, people exploit the toler- 
ance for imprecise vision. For example, 
if an object moves, you can't discern 
the detail. You calculate what the posi- 
tion of various points of that object 
might be, but you don't transmit that in- 
formation." 

This is an example of exploiting the tolerance for imprecision that doesn't use 
fuzzy logic or neural nets. But Zadeh is proposing a discipline known as "soft 
computing" that consciously exploits this tolerance and uses computing ap- 
proaches specifically tailored to deal with it. 

"If you consciously try to exploit the tolerance for imprecision, you can solve 
many problems that couldn't be solved otherwise," says Zadeh. "This is the guid- 
ing principle of what soft computing tries to do." 

Soft computing incorporates three main constituents: fuzzy logic, neural net- 
works and probabilistic reasoning. Probabilistic reasoning subsumes such exotic 
disciplines as belief networks, genetic algorithms, chaos theory and uncertainty 
management. Fuzzy logic focuses on approximate reasoning while neural net- 
works focus on curve fitting and learning. 

The art of soft computing will center on the appropriate application of one or 
more of these constituents to a given problem. The premise behind soft comput- 
ing is that traditional hard computing doesn't adequately reflect the imprecision 
and uncertainty of the real world. It says that trying to achieve precision and cer- 
tainty in such a world carries an unnecessary cost. On the other hand, tractability 
and robustness can be achieved at a relatively low cost by acknowledging and ex- 
ploiting the tolerance for uncertainty and imprecision. The exploration of the pos- 
sibilities for soft computing in control systems, as well as in such fields as risk as- 
sessment, finance and other fields, has just begun. The ultimate results are, at 
best, uncertain. 



where it can't reduce the error with 
further learning cycles, but still 
hasn't reached the desired error 
value. If it gets stuck in this way, it 
may need more data or the learning 
algorithm may need to be adjusted. 
At this point you can either feed it 
more data and run the algorithm 
again or implement simulated an- 
nealing. Simulated annealing ran- 
domizes some variable in the algo- 
rithm to jostle the learning process 
so that subsequent passes can bring 
the error to a lower value. The 
amount of error may initially in- 
crease before beginning to converge 



again. Plotting the convergence of 
such a system over the number of 
cycles will show a curve that rises 
and falls as it approaches the speci- 
fied accuracy. 

I Learning through repetition 

Like NeuFuz, the NeuroFuzzy mod- 
ule from Inform uses a neural net- 
work learning technique known as 
back propagation of error. In addi- 
tion, NeuroFuzzy supports several 
other learning methods. The back 
propagation approach feeds the dif- 
ference between the net's output and 
the expected output of the system to 



adjust the neural net's internal 
weights as it converges to a solution. 
Because NeuroFuzzy works with 
the same data representation as the 
fuzzyTECH tool, its output is avail- 
able for editing and user interven- 
tion much like a file created with 
fuzzyTECH. You'll usually start by 
defining some fuzzy structure that 
the NeuroFuzzy module can modify, 
based on the data it's learned. 

The fuzzyTECH NeuroFuzzy tool 
from Inform is an option that can be 
integrated with the main fuzzyTECH 
design environment. When you install 
it, it adds new DLLs to fuzzyTECH so 
that fuzzyTECH has new menus, new 
dialog boxes and new functionality 
within the system. The NeuroFuzzy 
module is very interactive since it's 
directly integrated with the fuzzy 
design tool. 

"It's like you have a magic mouse 
somewhere in fuzzyTECH that modi- 
fies parts of the system," says Con- 
stantin von Altrock, director of fuzzy 
logic at Inform. "When you start 
learning, you can actually see what 
the module is doing, such as how it 
modifies and generates membership 
functions. You can, of course, stop 
learning and intervene at any time 
in the process." 

The NeuroFuzzy module also has 
what Inform calls restricted learn- 
ing. You may already have a very 
clear idea of how some parts of the 
system are supposed to work and 
you don't need to learn data to im- 
plement them. So you can select any 
part of the system to learn. "There 
may be certain fuzzy logic rules that 
don't need to be changed," says von 
Altrock, "or other rules that you 
don't want the system to touch." 

I Making fuzzy make sense 

Paradoxically, neural networks are 
rather dumb when it comes to figur- 
ing out how to build a fuzzy logic 
rule base. In National's NeuFuz, for 
example, you start out by specifying 
the number of membership func- 
tions you want for each input and 
output. The neural net then learns 
the data and produces a file that's 
fed into the rule and membership 
function generator. This module pro- 
duces a set of all possible rules. For 
two inputs with five membership 
functions each, for example, there 
would be 25 rules; for three inputs 
at five membership functions there 
would be 125 rules, etc. 

In fuzzy logic, many rules actually 

continued on page 80 
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1 GIGABYTE MEMORY MODULE 

VME/V SB/VME64 



1 Gigabyte 
of FAST DRAM 

Chrislin Custom 
ASIC Chipset 

High-Speed VSB 
Interface 

Independent 
VME/VSB Address 
Selection 




Field Upgradeable 
to Full 
1GB Capacity 



High-Speed 
VME/VME64 
Interface 



ALU Processing 

Of Data 
During Transfers 



CI-VME80 



Up to 80 Mbytes/Sec Transfer Rate on VME64 
Up to 40 Mbytes/Sec Transfer Rate on VME/VSB 
Fully Supports IEEE 1014D Rev. D & VSB Rev.C 
32MB, 64MB, 128MB, 256MB, 512MB, & 1GB 
Block Cycle times of 93ns, Single Cycle times of 195ns 



Field Upgrade Options, 256MB to 512MB, or 1GB 
Enhanced Data Manipulation Functions in ALU Cycles 
Access Times of 30ns Write/Read in Block Cycle 
Dual-Ported VME/VSB and VME64 in one 6U slot 
LIFETIME WARRANTY 



The CI-VME80 is the ultimate memory board for VMEbus systems! Chrislin has designed the CI-VME80 with 
an onboard ALU to provide enhanced functionality for custom users. Available through AM codes are 64 bit 
arithmetic and logical functions (ADD,SUB,AND,OR,XOR)that will greatly enhance throughput in many applications. 
Simply write data to the location to be modified with the proper AM Code and the function is performed during the write cycle. 

Chrislin Also Provides The Following VMEbus Memory Boards 



C1-VME40 

4MB, 8MB, 16MB, 32MB & 64MB 
Block Cycle times of 84ns 
Single Cycle times of 1 95ns 
Block Cycle Access Time of 30ns 
Dual-Ported VME/VSB in one 6U slot 



CI-SRAM 

Non- Volatile High Speed VME Memory 
4MB or 16MB Static RAM 
16MB EPROM 

Two Selectable Write Protect Banks 
32 Bit BLT Transfer, 40MB Per Second 



CI-VSB-EDC 

Error Detection and Correction 
Single-bit Correction, Double-bit Detection 
Dual-Ported VME/VSB in one 6U slot 
4MB, 8MB, & 16MB 
VME & VSB configured independently 



FOR SPECIFICATIONS, AND ADDITIONAL INFORMATION 

Call 1-800-468-0736 

l Chrislin Industries, Inc. 

31312 Via Colinas #108, Westlake Village, CA 91362 USA 
TEL: (818) 991-2254 FAX: (818) 991-3490 

Providing Top Quality Memory For Two Decades! 



Circle 44 



■ SPECIAL REPORT: BRINGING FUZZY LOGIC & NEURAL COMPUTING TOGETHER 



Neural networks for fuzzy logic accuracy 



l^izzy logic techniques don't use a 
mathematical model of the system, 
which can be difficult, if not impossible, 
to obtain when working with complex 
systems. Conventional mathematical 
model-based techniques can only effec- 
tively address linear, time-invariant sys- 
tems, leaving many applications without 
viable solutions. Although fuzzy logic has 
proved successful in solving some of 
these types of problems, it's generally dif- 
ficult and time consuming to determine 
a correct set of rules and membership 
functions for a complex system. Fine tun- 
ing the fuzzy solution for a predictable 
level of accuracy is even more difficult. 

These problems can be effectively elimi- 
nated by combining neural networks with 
fuzzy logic. This approach uses neural net- 
works to learn system behavior based on 
system input-output data to a desired accu- 
racy, and generates fuzzy rules and mem- 
bership functions based on the learned 
system knowledge. The generated fuzzy 
solution provides the same desired accu- 
racy that the neural network was 
trained for. Combining these technolo- 
gies also minimizes system cost by opti- 
mizing the number of rules and mem- 
bership functions. 

I Language-based reasoning 

Fuzzy logic is an approximate reasoning 
technique that uses human-based lan- 
guage to describe a system's input-out- 
put relations, as opposed to crisp rea- 
soning used in conventional artificial 
intelligence, which requires a "yes" or 
"no" answer. 

Linguistic variables such as "high," 
"low," "medium," "hot," "cold" and 
so forth are used to describe the various 
degrees or levels of the inputs and out- 
puts. System inputs and outputs are re- 
lated by fuzzy rules using linguistic vari- 
ables and such rules can describe a 
system. Experts can use experience to 
describe the behavior of a system that's 
being considered using human-based 
language, which can better express un- 
certainties, imprecisions and nonlineari- 
ties. In this way, fuzzy logic techniques 
avoid a complex mathematical descrip- 
tion of the system, making its implemen- 
tation simpler and more cost-effective 
than conventional logic. 

The downside to using fuzzy logic in 
some applications is that it can be diffi- 
cult to write a correct set of rules and 
membership functions, particularly for a 



complex system. In applications where 
writing some initial approximate rules 
and membership functions is fairly sim- 
ple, the challenge is to properly tune 
these rules and membership functions to 
get a desired level of outcome accuracy. 

The accuracy of the result is checked 
against the current solution, and initial 
rules and membership functions undergo 
iterative tuning to improve it. This doesn't 
guarantee a solution that meets desired ac- 
curacy, however, and it generally takes a 
long time to develop the solution. 

I Learning and generalization 

Neural networks can be used to elimi- 
nate some of the shortcomings of fuzzy. 
A neural network is an artificial structure 
that mimics the human brain using sim- 
ple processing elements interconnected 
with varying connection strengths 
known as weights. A neural network has 



learning and generalization capabilities, let- 
ting it learn a system's input-output behav- 
ior. Learning is achieved by varying connec- 
tion strengths. Once a neural network is 
trained, it can be used to develop solutions 
to control the system for any input values 
within the specified range. 

Determining the correct set of input- 
output data for learning is very impor- 



tant because system performance de- 
pends on the learning (training). Input- 
output data can be obtained by measure- 
ments, experience, mathematical 
models, simulation or from an existing 
approximate fuzzy solution. Although 
neural networks have learning and gen- 
eralization capabilities, it's difficult to un- 
derstand how weight change really maps 
into the system input-output relation. 

I Combining neural with fuzzy 

Neural networks and fuzzy logic comple- 
ment each other by eliminating the limi- 
tations of each approach. The combina- 
tion makes it easy to generate fuzzy 
logic rules and membership functions. It 
also makes it easier to fine tune them. By 
using special architecture and proper de- 
sign of a neural system, such as in Na- 
tional Semiconductor's NeuFuz tool, 
learned knowledge can be directly 



mapped to fuzzy logic. This enables auto- 
matic generation of fuzzy logic rules and 
membership functions. 

The derived fuzzy logic solution pro- 
vides the same accuracy that the neural 
network was trained for and can easily 
be implemented on virtually any micro- 
controller. The combined technology can 
also optimize the solution (minimizing 



The NeuFuz tool from National Semiconductor feeds system input and output data 
along with application parameters into a neural network. When the data has been 
learned, the file is translated into a set of all the possible rules. The number of rules 
depends on the number of inputs and the number of membership functions speci- 
fied. The rule optimizer and verifier lets the user discard rules that don't significantly 
contribute to the solution. The system can then generate assembly or C code. 
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NeuFuz generated 
nonlinear membership functions 




Implementing nonlinear membership functions on a low-end embedded processor 
may be difficult. For such a processor, an approximated (trapezoidal like) membership 
function would be a better choice. 



the number of rules and membership 
functions) and minimize cost or improve 
response time. And because of the gen- 
eralization capability of neural networks, 
the derived fuzzy solution becomes more 
robust and reliable. The combined ap- 
proach can also help minimize the prob- 
lems associated with neural nets. 

NeuFuz is one approach where neural 
network technology has been effectively 
combined with fuzzy logic to eliminate 
some of the problems associated with 
fuzzy logic. The NeuFuz approach goes a 
step farther than some other hybrid solu- 
tions by using the learning and generali- 
zation capabilities of neural networks to 
achieve higher accuracy and shorter de- 
velopment time. This is accomplished by 
automatically generating fuzzy rules and 
membership functions to meet a desired 
accuracy and optimizing the solution. 

I Going nonlinear 

Fuzzy logic usually uses membership 
functions that have fixed geometric 
shapes. Because of the fixed shapes, 
such membership functions limit system 
knowledge more in the rule base than in 
the membership function base. Because 
of this, as the number of rules increase, 
so does the system's memory require- 



ments and processing time. Neural net- 
works alleviate this problem by learning 
nonlinear membership functions. This 
helps put more system knowledge in the 
membership function base, reducing the 
number of rules needed in the rule base 
and reducing memory requirements. 

Fuzzy logic uses heuristics in defuzzifi- 
cation, rule inferencing and antecedent 
processing methods. Although heuristics 
may work well for many solutions, they 
don't guarantee satisfactory solutions 
that operate under all conditions and 
wide input ranges. A combined neural- 
fuzzy approach, such as NeuFuz, would 
use neural network-based nonheuristic 
fuzzy logic algorithms for defuzzification, 
rule inferencing and antecedent process- 
ing, enabling direct mapping of neural 
networks to fuzzy logic. This direct map- 
ping to fuzzy logic provides several key 
advantages: 

• The neural network accuracy is fully 
maintained by the fuzzy logic solution. 
If the neural network is trained to be 
99 percent accurate, the generated 
fuzzy rules and membership functions 
will provide the same accuracy if no op- 
timization (i.e., no deletion of rules) is 
done. The loss of accuracy by optimiza- 



tion can be controlled and made insig- 
nificant. 

• The fuzzy solution inherits other fea- 
tures of neural networks. Because of 
the better generalization capability of 
neural networks, the derived fuzzy solu- 
tion is more robust and reliable and 
can work well under a wider range of 
input values. 

A solution's accuracy is usually man- 
aged in two steps: during neural net- 
work learning and during optimization. 
The neural network can be trained to a 
desired accuracy by specifying the accu- 
racy before learning begins. Learning 
continues until the desired accuracy is ob- 
tained. For some types of data, the learn- 
ing may not be completed at first trial. In 
such cases, some key parameters — such 
as learning rate and initial weights — can 
be adjusted to help converge the neural 
network. 

Optimization steps can begin once the 
learning process is completed to the de- 
sired accuracy. At this point, insignificant 
rules can automatically be detected and 
deleted, which may cause some loss of 
accuracy. But if this loss is insignificant, 
further optimization can be made by de- 
leting more rules, which simply involves 
manipulating the optimization parame- 
ters. On the other hand, some of the de- 
leted rules after the first optimization 
step may be re-added if accuracy falls be- 
low the desired level. 

The accuracy needs to be checked for 
both training and test data sets. Accu- 
racy for the training data is guaranteed 
by learning. This may not be the case for 
the test data, but its accuracy can easily 
be ensured by properly manipulating the 
neural network learning phase. This 
means a tighter accuracy than what's ulti- 
mately desired can be used during learn- 
ing. It also means that the neural net- 
work can be retrained with a modified 
training set that includes some of the 
previous test data that had a less-than- 
desired accuracy. In any case, a desired 
accuracy of the final solution can easily 
be obtained. 



. 
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continued from page 74 

make small contributions to the out- 
put. To build an efficient and robust 
system, you must figure out which 
rules to discard. This is often done 
the other way around by the de- 
signer who states how the system 
will work in natural language and 
from the designer's own knowledge. 
When the neural net presents you 
with all the possible rules, you're 
faced with the problem of figuring 
out which ones to get rid of. 

I Four inputs, one output 

NeuFuz currently supports four in- 
puts and one output which, at five 
membership functions each, could 
generate 3,125 rules. Most of these 
rules, however, wouldn't be used. 
The optimizer and verifier module 
supports a deletion factor that auto- 
matically discards rules that fall be- 
low a defined threshold. The dele- 
tion factor is a value between zero 



and one that indicates how much a 
given rule contributes to a solution. 
Setting a deletion factor of 0.1, for 
example, would eliminate rules that 
contributed no more than 1 percent 
to the solution. 

The verifier/optimizer also lets 
you edit the membership functions 
and test the selected rule base 
against a recall file. The recall file is 
a set of input data that tests to see 
if the design results correspond to 
the expected behavior. 

The files produced by Inform's 
NeuroFuzzy module are descrip- 
tions of a fuzzy logic system that can 
be accessed by all other parts of the 
design system. These include the 
linguistic variable editor, the rules 
editor, the graphic analyzer and the 
interactive debugger. 

The rules editor displays a 
graphic representation of the rules 
matrix known as a fuzzy associative 
memory (FAM), which also repre- 
sents the weights of the rules by 



display color and numerical value. 
By examining the rules matrix you 
can select sets of rules and evaluate 
their performance using the simula- 
tor or the graphic analyzer. You can 
also modify membership functions 
and put together a final set of rules 
that satisfy the performance re- 
quirements. 

Togai InfraLogic's TILGen tool 
uses neural network learning to 
generate rules from fuzzy input ob- 
jects that have already been defined. 
Using Togai's TILShell 3.0 develop- 
ment environment, you can supply a 
file written in Togai's Fuzzy Pro- 
gramming Language (FPL). The FPL 
file contains input and output ob- 
jects that are the system variables 
with sets of membership functions 
but no rules. You then supply a sepa- 
rate file containing input and output 
vector data. The data can be created 
by measuring the actual behavior of 
a system or can be specified as the 
system's desired behavior. 

TILGen, which is supplied as an 
integral part of Togai's TILShell 3.0 
professional edition, then applies 
the two files to the neural network. 
It processes the files and generates 
a new FPL file that contains a rule 
base consisting of rules and mem- 
bership functions. TILShell rule ma- 
trix and table editors, and the mem- 
bership function and variable 
editors can access the resulting FPL 
file. In the Togai environment, 
therefore, you need to be clear about 
the input and output variables, and 
the definition of their membership 
functions. You also must have a clear 
picture of the system's expected be- 
havior to use the neural network 
capability of TILGen. 

I Detailed specs required 

All the tools that use neural net 
technology require detailed specifi- 
cations of system behavior in terms 
of input and output data. If that data 
is taken by measuring some already- 
running system controlled by some 
other method, the tools don't neces- 
sarily require that you understand 
the system's behavior. They can ac- 
tually help provide a better under- 
standing of that behavior. 

The same is true of classical con- 
trol approaches that use a mathe- 
matical model to develop a control 
strategy. Either one must describe 
the system's behavior with a set of 
detailed equations or derive those 
equations from data. Tools that ana- 
lyze system performance data for 
classical control strategies include 



Anatomy of a neural network 

(a) w, 



(h) 




Input layer Hidden layers Output layer 





A neural network consists of layers of individual neurons. A neuron (a) takes input 
from many other neurons and sends output to many others (b). Each input is multi- 
plied by its weight. When the sum of the weighted inputs (Wi, W2, . . . W n ) reaches 
a threshold value, the neuron "fires. " As the neural net reads the training data set, 
it adjusts its internal weights so that the inputs produce an output that's close to the 
desired value. Each pass through the entire training set is a learning cycle. 
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MATLAB graphics enhance understanding of neural network behavior. This phi compares training rates for standard backpropagation (white. 108 steps) 
and the fast Levenberg-Marquardt algorithm (blue. 5 steps). Each trace illustrates the number of steps from initial conditions to the minimum error. 

Introducing Version 2.0 of 
the Neural Network Toolbox 



MATLAB 
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Neural Network 
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Both newcomers and 
experts have found the 
MATLAB' Neural Network 
Toolbox to be ideal for exploring 
and applying neural networks to 
fields as diverse as signal process- 
ing, nonlinear control, and finan- 
cial modeling. 

Now, version 2.0 offers five new 
network paradigms, major speed 
improvements, and expanded sup- 
port for experimentation. 

Beyond backpropagation 

The MATLAB Neural Network 
Toolbox offers over fifteen proven 
network architectures and learn- 
ing rules. You can choose among 
feed-forward, recurrent, associa- 
tive, and self-organizing network 
paradigms, using supervised or 
unsupervised training. 
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The first neural network 
engineering environment 

The Neural Network Toolbox is a 
complete engineering environ- 
ment for neural network research, 
design, and simulation. Unlike 
other neural network packages, 
you never work in isolation from 
real world considerations. 

Flexible data import and trans- 
formation functions simplify 
preprocessing of input data. 
Powerful analysis and advanced 



graphics help you evaluate 
network behavior and perfor- 
mance in the context of complete 
system designs. 

With no limits on network size 
or connectivity, you can implement 
networks as complex as your 
application demands. 

You can easily change any 
architecture, learning rule, or 
transfer function — or add new 
ones — without writing a single 
line of C or Fortran. 



Neural Network Controller Simulation 
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NeuroFuzzy technologies 



I he key benefit of fuzzy 
logic is that it lets you de- 
scribe system behavior with 
simple "if-then" relations. In 
many applications, this gets 
you a simpler solution in less 
time. You can also use all 
available engineering know- 
how to directly optimize the 
performance. While this is cer- 
tainly the beauty of fuzzy 
logic, it's also a major limita- 
tion. In many applications, 
the knowledge that describes 
a system's behavior is con- 
tained in data sets. Here, the 
designer has to manually de- 
rive the "if-then" rules from 
the data sets, which imposes 
a major effort with large data 
sets. 

Many people have sug- 
gested neural nets as a means 
of training a desired system 
behavior from data sets. But 
neural net solutions have pro- 
duced better results than 
other methods in only a few 
applications. 

I In the dark 

Neural nets are rarely used in 
applications for several rea- 
sons. First, a neural net solu- 
tion remains a "black box." 
You can't interpret what 
causes a certain behavior, or 
manually modify a neural net 
to change a certain behavior. Second, 
neural nets require prohibitive computa- 
tional effort for most mass-market prod- 
ucts. Third, selecting an appropriate net 
model and setting the parameters of the 
learning algorithm is still a "black art" 
and requires a lot of experience. But of 
all these, the lack of an easy way to ver- 
ify and optimize a neural net solution is 
probably the major limitation. 
Both neural nets and fuzzy logic are 



Mapping a fuzzy logic system 
to a neural network 



Fuzzification 



Inference 



Defuzzification 





The NeuroFuzzy Module maps a neural net to a fuzzy logic 
system. This lets the powerful neural net learning algorithms 
be used with fuzzy logic systems. 



powerful design techniques with their 
own strengths and weaknesses. Neural 
nets can learn from data sets while fuzzy 
logic solutions are easy to verify and opti- 
mize. If you compare these properties, 
it's apparent that a clever combination 
of the two technologies can deliver the 
best of both worlds. Combine the ex- 
plicit knowledge representation of fuzzy 
logic with the learning power of neural 
nets, and you get NeuroFuzzy. 



Ten years ago, there was a 
major milestone in the devel- 
opment of neural net technol- 
ogy: the creation of the so- 
called error back propagation 
algorithm. This learning ap- 
proach proved to be very pow- 
erful and most neural net ap- 
plications use it today. First, it 
computes the output values 
of the neural net for the input 
values of the current training 
example. Then, it compares 
these output values to the de- 
sired output value given by 
the training example. The dif- 
ference, known as error, is 
now used to determine how a 
neuron in the net is modified. 
The mathematical map of the 
error back into the net is 
known as error back propaga- 
tion. 

Since this learning ap- 
proach has already proved 
that it's usable, why not use it 
for fuzzy logic systems as 
well? This isn't as easy as it 
seems. The problem is that to 
determine which neuron had 
what effect, the error back 
propagation algorithm has to 
mathematically differentiate 
the transfer function of the 
neurons. If you want to apply 
the error back propagation al- 
gorithm to a fuzzy logic sys- 
tem, the problem is that the 
fuzzy logic inference generally isn't differ- 
entiate. 

To overcome this problem, some 
neuro-fuzzy development tools use an 
extended fuzzy logic inference method 
based on Fuzzy Associative Memories 
(FAMs). These FAMs can be considered a 
generalization of normal fuzzy logic 
rules. Because they can also be mathe- 
matically transferred to neurons in a neu- 
ral net, a modified error back propaga- 



the MATRIXx tools from Integrated 
Systems Inc. (1ST— Santa Clara, CA) 
and Matlab from The Math Works 
(Natick, MA). 

If you start designing a system us- 
ing fuzzy logic alone, you might not 
start with a clear idea of just how the 
system will behave for all input con- 
ditions. Or you might not know just 
which combination of inputs will be 



needed to produce the desired out- 
put condition. Eventually, you'll 
have to gain a better idea of input- 
output relationships by trial and er- 
ror and through simulation. 

I Work avoidance is the idea 

There's really no way of getting 
around a certain amount of work 
involved in designing a control sys- 



tem. The choice is more a matter of 
which tools to apply to avoid extra 
work by taking maximum advan- 
tage of the information you already 
have. This becomes especially im- 
portant as the complexity of the de- 
sign job and the attendant combina- 
torial complexity of inputs and 
outputs increases. 

Interestingly, National Semicon- 
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tion algorithm can be used. 

When you start with a NeuroFuzzy de- 
sign, the first step is to obtain the data 
sets that represent the desired system be- 
havior. Each data set gives sample output 
values for a given combination of input 
variables. The NeuroFuzzy training proc- 
ess starts with a fuzzy logic system. If you 
haven't set up your fuzzy logic system 
yet, the NeuroFuzzy Module can auto- 
matically set up an initial system for you. 
It analyzes the data sets and proposes a 
system structure. You can either accept 
this structure or modify it, before 
fuzzyTECH generates this system with 
default membership function definitions 
and default rules. 

In the next step, you select the parts of 
the system that the NeuroFuzzy Module 
may modify. This is a major advantage over 
neural learning, since it lets you control the 
training process. This is especially true 
when you use the NeuroFuzzy Module to 
optimize an existing fuzzy logic system — 
you can exclude parts of the system from 
learning. Also, if you have data sets repre- 
senting different aspects of the system per- 
formance, you may direct the NeuroFuzzy 
Module to learn different parts of the sys- 
tem from different data sets. 

When you start training, graphical edi- 
tors show how the NeuroFuzzy Module 
modifies rules and membership func- 
tions. You can interrupt the training at 
any time, either for system analysis or for 
manual modification. You can continue 
the training with the current or a differ- 
ent data set at any time. Also, you can 
set termination conditions if you don't 
want to manually control the training 
progress. The training result is a fuzzy 
logic system. 

Another advantage of NeuroFuzzy is 
that the generated code is much more ef- 
ficient compared to neural nets. Comput- 
ing a NeuroFuzzy system on a microcon- 
troller or a PC may require as little as 0.1 
ms and 1 kbyte of memory. In contrast, 
the neural net implementation of a simi- 



lar complex system may use about three 
times as much code and 100 times as 
much computing time. This lets you inte- 
grate NeuroFuzzy solutions in most real- 
time applications. 

In addition to automatic generation of 
fuzzy logic systems using sample data, 
NeuroFuzzy lets you tune systems while 
they're running, either to increase their 
performance or to cope with changing 
parameters in the environment. If you 
use fuzzy logic, you define the system be- 
havior explicitly; with NeuroFuzzy you de- 
fine it implicitly by examples. With Neuro- 
Fuzzy adaptive systems, you only tell it 
what the goal of its behavior is. 

I A case study 

AEG of Germany has used fuzzyTECH's 
NeuroFuzzy Module to reduce the water 
and energy consumption of its new 
generation of washing machines. Using 
the signal of an existing sensor in the 
washer's drum, a NeuroFuzzy system esti- 
mates the amount and the type of laundry. 

If washing experts know the amounts 
and types of laundry, they can determine 
how much water is needed in the wash- 
ing and rinsing steps. But the washing 
machine doesn't know the type and 
amount of laundry, and having the user 
enter this information makes the ma- 
chine too complicated. And adding spe- 
cial sensors would be too expensive. As a 
result, the machine is programmed for 
the maximum load possible, wasting 
water and energy. 

AEG turned to Inform Software for a 
different solution. After the machine is 
loaded with the laundry, the water valve 
opens and fills the drum to a defined 
level. The drum is then rotated in a cer- 
tain rhythm, dipping the laundry in the 
water. The laundry sucks up water, with 
the speed and volume depending on the 
type and amount of laundry. This is meas- 
ured by an analog pressure sensor that 
previously was only used for water level 
control. 



The resulting sensor signal is difficult 
to interpret. While the AEG washing ex- 
perts know the amount of water re- 
quired for different laundry loads, they 
have no experience in interpreting the 
sensor signal curves. On the other hand, 
many washing experiments have been 
conducted with known laundry loads 
and recorded sensor signal curves. 

This is where the fuzzyTECH NeuroFuzzy 
Module solved the problem. We gave the 
washing experts data sets of the experi- 
ments showing only the laundry load. The 
washing experts recommended how much 
water should be used in the washing steps 
for the given load. 

These data sets were used to train a 
fuzzy logic system with the NeuroFuzzy 
Module. The fuzzy logic system's input is 
the sensor signal curve recorded in the 
washing experiments. The desired out- 
puts for the fuzzy logic system are the 
water amounts that will be used in the 
washing steps. The laundry load wasn't 
used for training. 

By analyzing the input data patterns, 
initial fuzzy logic membership functions 
are generated. The actual learning proc- 
ess generated 1 57 rules for the fuzzy 
logic system. Preparing the data sets, set- 
ting up the system, NeuroFuzzy training 
and final test only required two man 
weeks of effort. 

Field tests prove that this solution saves 
20 percent of the average water consump- 
tion in everyday use compared to AEG's pre- 
vious machine, which already was an indus- 
try leader in water conservation. Since all 
European washing machines use electricity 
for water heating, average energy con- 
sumption was cut by 20 percent as well. 
The NeuroFuzzy solution uses the existing 
sensor and runs on the existing 8-bit micro- 
controllers. The product is a major market 
success for AEG. 







ductor found that its NeuFuz tool 
helped some customers achieve 
their design goals and simplify the 
hardware design by reducing the 
number of sensors. The present 
NeuFuz tool provides four inputs 
and one output. On the surface, that 
seems rather limited and the com- 
pany is considering a six-input/two- 
output version. "One reason we use 



a simple approach is because it sat- 
isfies 90 percent of the applications," 
says National's Khan. 

According to Khan, customers us- 
ing NeuFuz have started off with 
six, seven or eight inputs. "But when 
they started measuring data on 
those inputs, they found that some 
were so closely interrelated — the 
correlation was so high — that hav- 



ing those separate inputs wasn't 
necessary." It was often possible to 
average such interrelated inputs 
and get to an acceptable perform- 
ance while reducing the number of 
sensors providing input. "One objec- 
tive is to reduce the amount of sens- 
ing you have to do and reduce cost," 
says Khan. 

Using neural nets with fuzzy logic 
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systems certainly has potential 
benefits. One major question, how- 
ever, is how to make those benefits 
available to users without requiring 
the specialized skills involved with 
neural network technology. "My ex- 
perience with neural nets," says Hy- 
perlogic's Fred Watkins, "is that 
they are basically wild horses and 
one must be a skilled rider in order 
to tame them." In addition to neural 
nets, "any statistical procedure that 
can adjust the parameters success- 
fully is a viable candidate" for tun- 
ing and/or generating fuzzy sys- 
tems, he notes. 

Hyperlogic's CubiCalc tool com- 
bines a fuzzy development and deci- 
sion support system with a simula- 
tion engine. Watkins says a lot of 
people have expressed interest in a 
fuzzy/neural hybrid but some 
method other than a neural net 
might be a more appropriate 
method. "I think I know how it can 
be done without a lot of neural net 
mumbo-jumbo," he says. "To the de- 
gree that it involves neural nets, the 
net will be under the hood." The 
usability of any such tools will de- 
pend on the extent they can aid the 
user in finding correlations within 
sets of raw data and then using that 
data to construct effective control 
strategies. At the moment, neural 
nets appear to have a leg up as com- 
pliments to fuzzy tools, but time and 
the verdict of the users will ulti- 
mately decide. ■ 



For more information about the technolo- 
gies, products or companies mentioned 
in this article, call or circle the appropriate 
number on the Reader Inquiry Card. 
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